0. Performance

0.1 Record Count

1. File Statistics

1.1 Number of file accessed by each rank

1.2 Access mode of each file

Filename File Size Open Flags Read Write
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_4.bin 30730000 ['rb'] True False
/p/lustre2/wang116/applications/lbann/model_zoo/optimizers/opt_adam.prototext 97 ['O_RDONLY'] True False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_2.bin 30730000 ['rb'] True False
/p/lustre2/wang116/applications/lbann/experiments/sys 0 [] False False
/p/lustre2/wang116/applications/lbann/experiments/model_3.prototext 4208 ['r'] False False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_5.bin 30730000 ['rb'] True False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_1.bin 30730000 ['rb'] True False
/p/lustre2/wang116/applications/lbann/experiments/model_2.prototext 4209 ['r'] False False
/p/lustre2/wang116/applications/lbann/experiments/model_5.prototext 3208 ['r'] False False
/p/lustre2/wang116/applications/lbann/experiments/model_6.prototext 3206 ['r', 'w'] False True
/ 0 ['O_RDONLY'] False False
/p/lustre2/wang116/applications/lbann/experiments/model_4.prototext 3206 ['r'] False False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_3.bin 30730000 ['rb'] True False
/p/lustre2/wang116/applications/lbann/model_zoo/data_readers/data_reader_cifar10.prototext 873 ['O_RDONLY'] True False
/p/lustre2/brainusr/datasets/cifar10-bin/test_batch.bin 30730000 ['rb'] True False
/p/lustre2/wang116/applications/lbann/experiments/model.prototext 4206 ['r'] False False
/p/lustre2/wang116/applications/lbann/model_zoo/models/autoencoder_cifar10/model_autoencoder_cifar10.prototext 2531 ['O_RDONLY'] True False

2. Function Statistics

2.1 I/O Layers

2.2 POSIX I/O Patterns

2.3 Function count


3. Access Patterns

3.1 Overall I/O activities

3.2 Accessed offsets VS ranks

3.3 Accessed offsets VS time

3.4 File access patterns

Filename RAR(Same Rank) RAW(Same Rank) WAW(Same Rank) WAR(Same Rank) RAR(Different Rank) RAW(Different Rank) WAW(Different Rank) WAR(Different Rank)
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_1.bin False False False False True False False False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_4.bin False False False False True False False False
/p/lustre2/wang116/applications/lbann/experiments/model_6.prototext False False False False False False False False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_3.bin False False False False True False False False
/p/lustre2/wang116/applications/lbann/model_zoo/optimizers/opt_adam.prototext False False False False True False False False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_5.bin False False False False True False False False
/p/lustre2/wang116/applications/lbann/model_zoo/models/autoencoder_cifar10/model_autoencoder_cifar10.prototext False False False False True False False False
/p/lustre2/brainusr/datasets/cifar10-bin/test_batch.bin False False False False True False False False
/p/lustre2/brainusr/datasets/cifar10-bin/data_batch_2.bin False False False False True False False False
/p/lustre2/wang116/applications/lbann/model_zoo/data_readers/data_reader_cifar10.prototext False False False False True False False False

4. Count of I/O access sizes